WHAT IS CLAIMED IS: 

1. A method of detecting and correcting defective pixels in raw data 
taken from an image sensor used to obtain a digitized image, wherein said raw data 
includes normal pixels and defective pixels, said method comprising the steps of: 

(a) receiving a raw data signal for each pixel in said image; 

(b) computing for each pixel received from said image sensor a brightness 

value; 

(c) computing for each pixel received from said image sensor a local 
brightness value; 

(d) computing for each pixel received from said image sensor a local 
brightness deviation of said brightness value from said local brightness value; 

(e) setting a deviation threshold; 

(f) comparing for each pixel received from said image sensor, its local 
brightness deviation to said deviation threshold and designating pixels having local 
brightness deviations greater than said deviation threshold as defective pixels; 

(g) recording the location of said defective pixels in a statistical database; 

(h) recording the frequency of occurrence of said defective pixels in said 
statistical database; and 

(i) correcting the brightness value of said defective pixels, provided said 
correcting is warranted by trends from said statistical database. 

2. The method of claim 1, wherein said local brightness value is the 
arithmetic average of the brightness values of all pixels immediately neighboring and 
surrounding said pixel. 

3. The method of claim 1, wherein said local brightness deviation is 
the absolute value of the difference between said pixel's brightness value and said pixel's 
local brightness value. 

4. The method of claim 1, wherein said correcting is achieved by 
replacing said defective pixel's brightness value by said defective pixel's local brightness 
value. 

5. The method of claim 1, performing said detecting and correcting of 
said defective pixels dynamically and without any operator intervention. 
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1 6. • The method of claim 1, wherein said image sensor is a part of a 

2 digital video camera. 

1 7. The method of claim 1, wherein said image sensor is a part of a 

2 digital still camera. 

1 8. The method of claim 1, wherein said image sensor is one of (a) a 

2 charge-coupled device (CCD) image sensor array and (b) a complimentary metal oxide 

3 semiconductor (CMOS) image sensor array. 

1 9. The m^ethod of claim 1, wherein said raw data is the unprocessed 

2 brightness value data which is output by said image sensor which has not gone through 

3 either lossy compression or color processing. 

1 10. The method of claim 1, performing said detecting and correcting 

2 on a portion of said raw data obtained from said image sensor array corresponding to a 

3 portion of a frame of a video image. 

1 11. The method of claim 1 , performing said detecting and correcting 

2 on a portion of said raw data obtained from said image sensor array corresponding to a 

3 portion of a still digital image. 

1 12. The method of claim 1, wherein said statistical database, by storing 

2 the location and frequency of defective pixels, develops over time trends which confirm 

3 which of said defective pixels are warranted for pixel correction, wherein said trends 

4 initially warrant pixel correction as a default and over time warrant pixel correction only 

5 if a particular defective pixel has an occurrence frequency of at least two out of four 

6 queries. 

1 13. The method of claim 1, wherein said detecting includes video 

2 subsampling, wherein using video subsampling said detecting is carried out on video data 

3 frames at a rate between one of every 128 video frames and 1 of every 32 video frames, 

4 and wherein said correcting is continuous on every video data frame. 

1 14. The method of claim 1, wherein said detecting includes video 

2 subsampling, wherein using video subsampling said detecting is carried out on video data 
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frames at a rate of one of every n times X frames, where n is an integer and where X is 
not equal to either 50 or 60. 

15. A dynamic method requiring no user intervention for detecting and 
correcting defective pixels in raw data taken from an image sensor which is part of one of 
(a) a digital video camera and (b) a digital still camera, used to obtain a digitized image 
which is sensed by a camera and transmitted over a bus to a PC, wherein said raw data 
includes normal pixels and defective pixels, said method comprising the steps of: 

(a) receiving raw data signals for each pixel fi"om said image; 

(b) computing for each pixel received from said image sensor a brightness 

value; 

(c) computing for each pixel received from said image sensor a local 
brightness value, wherein said local brightness value is the arithmetic average of the 
brightness values of all pixels immediately neighboring and surrounding said pixel; 

(d) computing for each pixel received from said image sensor a local 
brightness deviation of said brightness value from said local brightness value, wherein 
said local brightness deviation is the absolute value of the difference between said pixel's 
brightness value and said pixel's local brightness value; 

(e) setting a deviation threshold; 

(f) comparing for each pixel received from said image sensor, its local 
brightness deviation to said deviation threshold and designating pixels having local 
brightness deviations greater than said deviation threshold as defective pixels; 

(g) recording the location of said defective pixels in a statistical database; 

(h) recording the frequency of occurrence of said defective pixels in said 
statistical database; and 

(i) correcting the brightness value of said defective pixels, provided said 
correcting is warranted by trends from said statistical database, wherein said correcting is 
achieved by replacing said defective pixel's brightness value by said defective pixel's 
local brightness value, wherein said statistical database warrants pixel correction if a 
particular defective pixel has an occurrence frequency of at least two out of four queries; 
and 

wherein said detecting is carried out on video data at a rate of one of (a) 
between one of every 128 video frames and 1 of every 32 video frames, and (b) one of 
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very n times X frames, where n is an integer and X in not equal to either 50 or 60, and 
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where said correcting is carried out continuously on every video data frame. 
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16. A system for detecting and correcting defective pixels in raw data 
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taken from an image sensor used to obtain a digitized image, wherein said raw data 






include^; normal nixels and defective nixels said svstem comnrisins: 
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(a) an image sensor to record an image of a scene, said image sensor 






rnntainincr a trriH nf nhotn<;ite«* to convert lipht shininff on said nhotosites to electrical 




6 


charges, wherein said electrical charges are converted to a series of analog charges which 
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are then converted to digital signals by an analog to digital converter when said image is 
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read off said sensor and; 
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(b) an intelligent host configured to receive said digital signals from said 
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image sensor, wherein said intelligent host a computer program product comprising: 
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(i) a computer usable medium having computer readable code embodied 
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therein for causing the detection and correction of said defective pixels, said computer 
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nropram nroduct comnrisinff* 
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(1) computer readable program code devices configured to cause a 
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romniiter to receive a raw data sienal for each nixel in said imaeei 
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(2) computer readable program code devices configured to cause a 
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rnmnntf^r to rnmmitp for each nix el received from said imase sensor a brishtness value i 
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/''^^ rnmniiter readable nroo^ram code devices confieured to cause a 
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computer to compute for each pixel received from said image sensor a local brightness 
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(4) computer readable program code devices configured to cause a 
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rnmniiter to comnute for each nixel received from said image sensor a local brightness 






Hf=»viation of* <;fliH briphtne<;<; value from said local brightness value* 
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computer to set a deviation threshold to be used in conjunction with said local brightness 
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(^0 ) computer reaaaoie program coae aevit/cs coniigur cu lu wdubc <x 
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computer to compare for each pixel, its local brightness deviation to said deviation 
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threshold and designate pixels having local brightness deviations greater than said 
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deviation threshold as defective pixels; 
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(7) computer readable program code devices configured to cause a 
computer to record the location of said defective pixels in a statistical database; 

(8) computer readable program code devices configured to cause a 
computer to record the frequency of occurrence of said defective pixels in said statistical 
database; and 

(9) computer readable program code devices configured to cause a 
computer to correct the brightness value of said defective pixels, provided the correction 
is warranted by trends from said statistical database. 

17. The system of claim 16, wherein said image sensor transmits said 
digital signals to said intelligent host via a bus, wherein said bus connects said image 
sensor to said intelligent host. 

18. The system of claim 16, wherein said intelligent host is a server. 

19. The system of claim 16, wherein said intelligent host is a personal 

computer. 

20. The system of claim 16, wherein said local brightness value is the 
arithmetic average of the brightness values of all pixels immediately neighboring and 
surrounding said pixel. 

21. The system of claim 16, wherein said local brightness deviation is 
the absolute value of the difference between said pixel's brightness value and said pixel's 
local brightness value. 

22. The system of claim 16, wherein said correction is achieved by 
replacing said defective pixel's brightness value by said defective pixel's local brightness 
value. 

23. The system of claim 16, wherein said image sensor array is one of 
(a) a charge-coupled device (CCD) image sensor array and (b) a complimentary metal 
oxide semiconductor (CMOS) image sensor array. 

24. The system of claim 16, wherein said raw data is the unprocessed 
brightness value data which is output by said image sensor which has not gone through 
either lossy compression or color processing. 
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25. The system of claim 17, wherein said bus is one a (a) universal 
serial bus (USB) and (b) a parallel port. 



26. The system of claim 16, performing said detecting and correcting 
of said defective pixels dynamically and without any user intervention. 

27. The system of claim 16, wherein said image sensor is a part of a 
digital video camera. 

28. The system of claim 16, wherein said image sensor is a part of a 
digital still camera. 

29. The system of claim 16, performing said detecting and correcting 
on a portion of said raw data obtained from said image sensor array corresponding to a 
portion of a frame of a video image. 

30. The system of claim 16, performing said detecting and correcting 
on a portion said raw data obtained from said image sensor array corresponding to a 
portion of a still digital image. 

31. The system of claim 16, wherein said statistical database, by 
storing the location and frequency of defective pixels, develops over time trends which 
confirm which of said defective pixels are warranted for pixel correction, wherein said 
trends initially warrant pixel correction as a default and over time warrant pixel correction 
only if a particular defective pixel has an occurrence frequency of at least two out of four 
queries. 

32. The system of claim 16, wherein said computer program causes 
said detecting to be carried out on video data frames at a rate between one of every 128 
video frames and 1 of every 32 video frames, and said computer program causes said 
correcting to be carried out continuously on every video data frame. 

33. The system of claim 16, wherein said computer program causes 
said detecting to be carried out on video data frames at a rate of one of every n times X 
frames, where n is an integer, and where X is not equal to either 50 or 60, and said 
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computer program causes said correcting to be carried out continuously on every video 
data frame. 

34. The system of claim 16, wherein said computer program product 
consists of an anomalous pixel detection portion, an anomalous pixel correction portion 
and a statistical analysis portion. 

35. The system of claim 16, wherein execution of said computer 
program product does not increase processor load by more than between 1 percent to 80 
percent. 

36. The system of claim 16, wherein execution of said computer 
program product does not reduce video processing by more than 1 frame per second. 



16 



